2nd RAMI
Cascade Campaign for Aerial Robots Results
The second edition of RAMI evaluation campaigns for aerial robots, held in conjunction with the International Conference on Unmanned Aircraft Systems (ICUAS) 2023. The competition is taking place in two subsequent stages. First, the cascade evaluation campaign run from January to April 2023, where teams have developed and tested their algorithms on datasets provided by CATEC.
The Cascade evaluation campaign allowed us to select the best performing teams to participate in the field evaluation campaign (second stage), which will take place at the ICUAS conference venue in June 2023 in Warsaw, Poland. The teams will be notified about details.
Results
FBM1 – Precise navigation without GNSS
| Rank | Team | RMSE [m] |
| 1 | RAS-lab | 1.047130 |
| 2 | CVAR | 3.083009 |
| 3 | PAIRlab | 3.610801 |
| 4 | UAS-DTU | 4.012093 |
| 5 | Carrot | 5.493141 |
| 6 | SDCNlab | 6.859361 |
| 7 | UMIC | 7.723799 |
| 8 | Avant-UFMG | 10.088815 |
| 9 | Purple Bee | 47.980188 |
FBM2 – Automatic detection of defects
| Rank | Team | CSI |
| 1 | Carrot | 0.615385 |
| 2 | UMIC | 0.6 |
| 3 | RAS-lab | 0.571429 |
| 4 | CVAR | 0.47619 |
| 5 | SDCNlab | 0.347826 |
| 6 | DMA | 0.333333 |
| 6 | UAS-DTU | 0.333333 |
| 8 | PAIRlab | 0.133333 |
| 9 | Avant-UFMG | 0.0285714 |
| 10 | Purple Bee | 0 |
More information:
- RAMI’s Evaluation Plan
- Competition Description document
- Docker user guide document
- ICUAS’23 UAV Competition registration
Contact us at im(a)metricsproject.eu